
SERVER 



USER SUPPORT SYSTEM 



10 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.; Teruhiro Yamada et al. 
Dkt: 263/123 



2/40 



FIG.2 



14 



20 



COMMUNICATION UNIT 



URL 



H 



32 



UTTERANCE 
OBTAINING 
UNIT 



H 



44 



ACCESS 
RECORDER 



-34 



-30 



46 



UTTERANCE SEARCH UNIT 



INDEX FILE 




ACCESS 
INFORMATION 
FILE 



REPORTING 
UNIT 



-42 



40 



USER 

UTTERANCE 
COLLECTION 



UN I DENT I Fl EDI 
UTTERANCE 
FILE 



ORIGINATING SERVER 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Tenjhiro Yamada et al. 
Dkt: 263/123 



3/40 



FIG.3 



100 



102 



104 



m 

m 
m 



y 

i3 



A 


AH 


f001 




ARIGATO 

(THANK YOU) 


f112 




• 
















K 








KON-NICHIWA 
(HELLO) 


f045 




• 











36 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



FIG. 4 



4/40 



104 



102 



120 



Q 

m 
m 

1:1 

m 



Q 



f044 


Hi 


URLa43 


f045 


Hel lo 


URLa1/URLa2 




• 

m 




f120 


Good by 


URLa122 




f267 


Recommend a recipe. 


URLbSO 


f268 


Te 1 1 me a good 
Chinese dish. 


URLb14 




• 




f306 


How much in 
ca lor 1 e? 


URLb6 



H10 



H12 



38 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



5/40 



FIG. 5 



userl 


CHAT. RECIPE. AUCTION 


user2 


TRAVEL, PC 







46 



m 

m 



Hi 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkl: 263/123 



6/40 



FIG.6 



14 



COMMUN I CATION UNIT 



24 



URL 



60 



62 



64 



URLal PAGE 



70- 



74- 



76- 



AGENT OUTPUT UNIT 



USER UTTERANCE 
OBTAINING UNIT 



SPECIFIC PROCESS 
EXECUTION UNIT 



URLa2 PAGE 



URLan PAGE 



72 



>-3 



AGENT DATA 



-66 



-68 



AGENT ACTION COLLECTION 



CHAT SERVER 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Tenjhiro Yamada et al. 
Dkt: 263/123 



7/40 



FIG. 7 



14 



COMMUNICATION UNIT 



■130 



132 



LOCAL AGENT OUTPUT 
UNIT 



136 



USER UTTERANCE 
INPUT UNIT 



-H USER INTERFACE 
1 



■138 



12 



134 



LOCAL AGENT 
DATA 



USER TERMINAL 



USER 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Temhiro Yamada et al. 
Dkt: 263/123 



FIG. 8 



8/40 



150 



http:// 



We I come ! 
Let' s chat. 




SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



FIG. 9 



9/40 



150 



http:// 



m 
m 
m 

lis 



lis 

M 




Hello! 

I am a chat agent. 
Call me Peako. 



154 



User Prompt 



Recommend a recipe. 



SEND 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
DM: 263/123 



IG. 10 



10/40 



150 



<=i l=> http:// 




OK! 

I am a recipe agent. 
Trust me. 



What kind of recipe 
wou I d you I i ke? 

154 



User Prompt 



Chinese cooking 



SEND 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Temhiro Yamada et al. 
Dkt: 263/123 



11/40 



■IG. 11 



150 



<=I [=> http:// 




Now, how about 
ingredients? 
Plese select one. 



Opoak Otofu 
®beaf Or ice 
Ofish O noodles 
O vegetable 
Oshr imp 



-162 



SEND 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt; 263/123 



FIG. 12 



12/40 



<=l[l> http:// 



Chinese 

recipe 

site 

OOO 



XXX 



AAA 



□ □□ 




How about these 
dishes? 



□Fried beef with green pepper 
□Fried beef with leeks 
□Fried beef with oyster sauce 

154 



-170 



User Prompt 



I would I ike to look at 
f I ight schedules. 



SEND 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



13/40 



FIG. 13 



e z 

w 
III 

IB 

!1J 

Si 

P 
hi 



3012 




USER 




TERMINAL 


( 



3014 




3020 






ENTRANCE 
SERVER 


URLa 


3024 






TRANSLATION 
SERVER 


URLb 


TRANSLATION 


SYSTEM 



-3016 



3010 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Temhiro Yamada et al. 
DM: 263/123 



14/40 



FIG. 14 



m 
m 



q 



3014 



COMMUNICATION UNIT 



3032 







UTTERANCE 






OBTAINING 


R 




UNIT 




URLb 




H 






30 






UTTERANCE 




SEACH 


UNIT 



R 



3038 



USER 

UTTERANCE 
COLLECTION 



ENTRANCE SERVER 



TL 



TL 



TARGET 
LANGUAGE 
SETTING 
UNIT 



3020 

A 



uw 



3030 



■3044 



UW 



3042 



REPORTING 
UNIT 



3040 



UNIDENTIFIED 
UTTERANCE 
FILE 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et aJ. 
Dkt: 263/123 



15/40 



3050 



3052 



3054 



FIRST 
CHARACTER 


UTTERANCE 


RECORD 


A 


ASA 
(MORNING) 


R003 


ARIGATO 
(THANK YOU) 


R112 


• 
• 
• 


■ 














K 


• 


• 


KON-NICHIWA 
(HELLO) 


R045 


• 
• 











3038 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



16/40 



16 



3014 



3060 



COMMUNICATION UNIT 



3062 



RECORD OBTAINING 
UNIT 



R 



TL 



CORRESPONDING 
EXPRESSION 
SEARCH UNIT 



3066 



DICTIONARY 
FILE 



-3064 



URLa 



INSTRUCTION 
OBTAINING 
UNIT 



3070 



3068 



FORMATTING 
UNIT 



SR 



TRANSLATION SERVER 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



17/40 



FIG. 17 



3054 



3080 



3082 



RECORD 



ENGLISH 



FRENCH 



R112 



® Thank you. (Normal) 

Thank you very much. 
(Polite) 



® Mergi. (Normal) 

® Mergi beaucoup. 
(Pol ite) 



R113 



3066 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



•IG. 18 



18/40 



http:// 



( VIRTUAL TRANSLATOR ) 



Wh i ch I anguage wou I d you I i ke 
translate into? 

® English O French O German 
OChinese O Spanish 



^3090 



•A Please input a sentence or a word to be 
translated. 



Ar igato 



-3092 



SEND 



-3094 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



19/40 



IG. 19 



<ZI [=> http:// 



( VIRTUAL TRANSLATOR ) 



English translations for 
"Ar i gato" : 

©Thank you. 



It's a normal expression. 

©Thank you very much. 

It' s a I ittle polite ^ 
expression. 



^3096 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



20/40 



FIG. 20 



m 
111 

m 
m 



START ^ 



S3010 



SET TARGET 
LANGUAGE 



S3012 



OBTAIN UTTERANCE 



S3014 



SEARCH 



S3016 




S3018 



TRANSLATE 



S3020 



FORMAT 



S3022 



PRESENT TO USER 



END ^ 



S3024 



RECORD AS UNIDENTIFIED 
UTTERANCE 



S3026 



REPORT TO ADMINISTRATOR 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



21 



21/40 



3014 



3020 



3030 



COMMUNICATION UNIT 



R 

URLb 



3102 



CHAT FUNCTION BLOCK 



Ul 



3034 



UTTERANCE 
SEACH UNIT 



H 



3038 



USER 

UTTERANCE 
COLLECTION 



WTHER 

TONGUE 
IDENTIFIER 



SR 



TL 



FORMATTING 
UNIT 

^ 

3104 



UW 



-3106 



REPORTING 
UNIT 



UW 



ENTRANCE SERVER 



UNIDENTIFIED 
UTTERANCE 
FILE 



3042 



.3040 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



22/40 



■IG. 22 



^Zl http://xxx. CO. jp/xxx 



fc^jftccDSPM : mm 



3120 



ken_123 : C^(c*,(io 

torn : ^B, /^X^-;/ hcDK^. M.lzn< cfc, 

mari_038 : kenli<b:**) t>? 

koji : torn. i:(D^—J^tm^tj:C07 

kenJ23 : t>-^3^£L^-eL^'5 



3124 



3122 



□ torn 

O mari_038 
O keiko 

□ ken_123 
O jane_306 

□ taro 

□ koji 

□ pierre 



3128 



-3126 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teojhiro Yamada et al. 
Dkt: 263/123 



23/40 



IG. 23 



http : //xxx. com/xxx 



Your Room : Entertainment 



3120 



ken_123 : Hel lo, everyone, 
torn : I go see basketba 1 1 
mari_038 : From where. Ken 
koji : Which team is your 
ken_123 : Connecting from 



today. 
? 

favor ite. torn 
Tokyo. 











Submit 



3124 



□ 
O 
O 
□ 
O 
□ 
□ 
□ 



3122 
torn 

mar i_038 
ke i ko 
kenJ23 
jane_306 
taro 
koj i 
pierre 



OTHER 
LANGUAGES 

— ^T"^ 

3128 

-3126 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
tnv.: Temhiro Yamada et al. 
Dkt: 263/123 



FIG. 24 



24/40 



a 

m 
m 

; 3 

iu 
m 
III 



IjJ 



4012 

USER 

TERMINAL 



USER 

TERMINAL 



4028 




TRAVEL 
SERVER 


i 

URLc 


i 


URLs 



CHAT 
SERVER 



4020 



USER SUPPORT SYSTEM 



-4016 



4010 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Temhiro Yamada et al. 
Dkt: 263/123 



25/40 



FIG. 25 



4014 



I 



COMMUNICATION UNIT 



H 



4032'^ 



UETTERANCE 
OBTAINING 
UNIT 



I 



4060 



AGENT 

CONTROLLER 



URL 



URL 



4034 
^ 



4044 
Z— 



ACCESS 
RECORDER 



UTTERANCE SEARCH UNIT 



4036 



INDEX FILE 



C 



URL 
4038 



USER 

UTTERANCE 
COLLECTION 



^REPORT 
^UNIT 



-4030 



4062 



ACCESS 

INFORMATION 

FILE 



NG 



4046 



ACCESS 

INFORMATION 

FILE 



^4042 
4040 



JL^ UNIDENTIFIED 
UTTERANCE 
FILE 



4048 



LIBRARY 
PROVIDER 



s 

4020. 4026. 4028 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



26/40 



FIG. 26 



4100 



4102 



4104 



*0 



m 



A 


AH 


fOOl 


ARIGATO 

(THANK YOU) 


f112 




• 














K 


• 


• 


KON-NICHIWA 
(HELLO) 


f045 




• 
• 









11 



4036 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



G. 27 



27/40 

4104 4102 4120 


f044 


Hi 


URLa43 


■ f045 


Hel lo 


URLa1/URLa2 


• 

• 
• 


• 




f120 


Good by 


URLa122 




f267 


RECOMMEND A RECIPE. 


URLb30 


f268 


Te 1 1 me a good 
Chinese dish. 


URLb14 






• 


f306 


How much in calorie? 


URLb6 




f511 


Recommend a domestic 
travel . 


URLc5 


f512 


Recommend a foreign 
travel. 


URLcSO 








f685 


1 want to go to a hot 
spr ing. 


URLc84 



M110 



Ml 12 



J 



Ml 14 



J 



4038 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



28/40 



FIG. 28 



user1 



CHAT. RECIPE. AUCTION 



user2 



TRAVEL. PC 



4046 



10 

W 
iV 
IaI 
111 
SB 

1^ 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
DM: 263/123 




G. 29 



29/40 



AGENT CONTROLLER 



URL 



-4060 



4062 



4064 



URLa1 PAGE 



4070- 



4076. 



AGENT OUTPUT UNIT 



SPECIFIC PROCESS 
EXECUTION UNIT 



URLa2 PAGE 



URLan PAGE 



-4066 



4072 



AGENT DATA 



-4068 

AGENT ACTION COLLECTION 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
• Dkt: 263/123 



m 

m 

m 



FIG. 30 



5012 



USER 

TERMINAL 



USER 
TERMINAL 



30/40 



TRAVEL 
SERVER 



-5028 



5024 




CHAT 
SERVER 


i 

URLa 


i 


URLs 



RECIPE k 
SERVER 



5026 



ORIGINATINGi 
SERVER 



5020 



USER SUPPORT SYSTEM 



-5016 



3*4 



5010 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Tenjhiro Yamada et al. 
Dkt: 263/123 



31/40 



FIG. 31 



5014 

▲ 



COMMUNICATION UNIT 



5020 



URL 



H 



UTTERANCE 
OBTAINING 
UNIT 



5032 



H 



5044 



ACCESS 
RECORDER 



L 



-5030 



5046 



>3 



-5034 



UTTERANCE SEARCH UNIT 



URL F 



INDEX 
FILE 



ADDITIONAL 

INDEX 

FILE 



X 
URL 



ACCESS 

INFORMATION 

FILE 



REPORTING 
UNIT 



.5042 



USER 

UTTERANCE 
COLLECTION 



ADDITIONAU 
UTTERANCE 
COLLECT I OM 



5036 



5037 



5038 



5039 



5040 



UNIDENTIFIED! 
UTTERANCE 
FILE 



5048 



LIBRARY 
PROVIDER 



ORIGINATING SERVER 



V 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



32/40 



FIG. 32 



5200 



5202 



5204 



O 

'Hep 
EES a 

iy 
W 
ry 

m 

ST Z 

'i W 



A 


AJI 

(TASTE) 


fOOl 


AISU-KURIMU 

( 1 Ot OKbAM) 


f134 


• 














K 


• 
• 




GYOZA 
(DUMPLING) 


f805 


■ 

• 


m 









5037 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



FIG. 33 



33/40 



id 

m 

m 
III 



I- 



5204 5202 


5220 






r 


^ C 


, ? 






f702 


How are you 
do i ne? 


URLa203 








f703 


rainv spason 


URLa255 




!^5210 




• 


• 


■ 






f757 




URLa244 


J 












^ 


f805 


dump 1 i ng 


URLb254 






f806 


go to see 
cherry blossoms 


URLb211 








m 










f854 


dinner 


URLb229 


J 














f911 


Ital ian 


URLc201 








f912 


f 1 ight 


URLc222 




)^5214 




• 


• 


■ 






f966 


sea 


URLc235 


J 






■ 
• 
• 







5039 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



FIG. 34 



34/40 



5150 



0=1 ■=> 



http:// 



5152 



m 
w 
m 
m 
ry 

E! 

Q 

m 
w 
o 



We I come ! 
Let' s chat! 




SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 




IG. 35 



<□ [=> Ihttp:// 



5156 



35/40 




Hel lo! 

I am a chat agent. 
Cal I me Peako. 



User Prompt 



5150 



5154 



Tell me today's new recipes at 
cooking site. 



SEND 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Tenihiro Yamada et al. 
Dkt: 263/123 



FIG. 36 

<=l [=> I http:// 



36/40 



5150 



m 

5 _ S 

m 

5! 




All right! 

I am a recipe agent. 

Trust me. 



I am going to search now. 
Wait a moment, please. 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



37/40 



FIG. 37 



5150 



<zi l=> I http:// 



New Recipes 



r 



Pasta with 
shrimp and 
tomato 



517(H 



Italian 
hamburger 




Today's new recipes are 
I tal ian dishes. 
Please click for cooking 
detai Is. 



SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
Dkt: 263/123 



38/40 



FIG. 38 



<Zl l=> jhttp:// 



New Recipes 



r 



Pasta with 
shrimp and 
tomato 



5170^ 



Ital ian 
hamburger 



5150 




Today's new recipes are 
Ital ian dishes. 
Please click for cooking 
detai Is. 



Wliat about joining an 
Italian gourmet tour to 
taste genuine Ital ian 
cuisine? 

DETAIL 



5180 




SA-70017US 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
Inv.: Teruhiro Yamada et al. 
DM: 263/123 



FIG. 39 



39/40 



50,30 



COMMUNICATION 
UNIT 



T 



5031 



AGENT UTTERANCE 
OBTAINING UNIT 



y"\. 



5032 



USER UTTERANCE 
OBTAINING UNIT 



5034 



UTTERANCE SEARCH UNIT 



5036 




INDEX 
FILE 



5038 



5039 



USER 

UTTERANCE 
COLLECTION 



ADDITIONAL 

UTTERANCE 

COLLECTION 



UTTERANCE IDENTIFICATION BLOCK 



5138 



USER INTERFACE 



5070 
^ 



AGENT CONTROLLER 



5062 



AGENT ACTION 
COLLECTION 



RESPONSE BLOCK 



SA-70017US 



4 



A USER SUPPORT APPARATUS 
AND SYSTEM USING AGENTS 
tnv.: Teruhiro Yamada et al. 
Dkt: 263/123 



40/40 



FIG. 40 



FIRST AGENT 



5300 
^ 




INDEX 
FILE 



USER 
UTTERANCE 
COLLECTION 



ADDITIONAL 

UTTERANCE 

COLLECTION 



UTTERANCE SEARCH UNIT 



I 



5031a 



5034a 



AGENT UTTERANCE 
OBTAINING UNIT 



I 



5032a| 



USER UTTERANCE 
OBTAINING UNIT 



5062a 



AGENT ACTION 
COLLECTION 



5070a 
^ 



AGENT CONTROLLER 



5030-^ 



COMMUNICATION 
UNIT 



USER INTERFACE 



J 



"S — 

5138 



5070b 



AGENT CONTROLLER 



5062b 



AGENT ACTION 
COLLECTION 



5032b 



5031b 



USER UTTERANCE 
OBTAINING UNIT 


AGENT UTTERANCE^ 
OBTAINING UNIT 




5034b 




UTTERANCE SEARCH UNIT 







i 








50^6b , 




5038b 




I 








r 



5039b 



INDEX 
FILE 



USER 

UTTERANCE 
COLLECTION 



ADDITIONAL 

UTTERANCE 

COLLECTION 



SECOND AGENT 



"^S 

5302 

SA-70017US 



